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BRIEF 


This  study  reports  on  the  development,  standardization, 
and  validation  of  new  forms  of  the  Officer  Qualification  Test 
to  replace  the  currently  operational  forms. 
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DEVELOPMENT  OF  THE  OFFICER  QUALIFICATION  TEST 
FORMS  7  AND  8 


INTRODUCTION 


Originally  it  was  planned  to  develop  three  new  forms  of 
the  Officer  Qualification  Test,  i.e.,  Forms  7,  8,  and  9.  How¬ 
ever,  Form  9  was  modified  after  its  development  to  serve  as  a 
base  for  a  new  Reserve  Officer  Candidate  (ROC)  Selection  Test, 
Though  there  is  no  Form  9  of  the  Officer  Qualification  Test 
available  for  administrative  use,  development  information  on 
Form  9  is  presented  in  this  report. 


PURPOSE 


The  Officer  Qualification  Test  needs  to  be  revised  period¬ 
ically  to  prevent  loss  of  effectiveness  due  to  compromise.  This 
study  reports  the  development,  standardization  and  validation  of 
the  Officer  Qualification  Test  Forms  7  and  8  to  replace  Forms 
5  and  6, 


PROCEDURE 


DEVELOPMENT  OF  FORMS  1,  8,  AND  9 

Description.  Each  new  form  of  the  OQT  retained  the  general 
format  and  the  three  sections  of  previous  OQT  forms — Verbal  Anal¬ 
ogies,  Mechanical  Comprehension,  and  Arithmetic  Reasoning,  The 
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Verbal  Analogies  section  emphasizes  understanding  of  conceptual 
relations  rather  than  knowledge  of  vocabulary.  The  Mechanical 
Comprehension  section  calls  for  ability  to  understand  mechanical 
principles  and  ability  to  apply  them  to  visually  presented  prob¬ 
lems,  The  Arithmetic  Reasoning  section  measures  skill  in  arith¬ 
metic  reasoning  and  problem  solving,  and  requires  an  understand¬ 
ing  of  basic  arithmetic  processes. 

Each  form  consisted  of  115  multiple-choice  items  arranged  in 
order  of  increasing  difficulty  within  each  of  the  throe  sections. 
Testing  time  was  l|-  hours.  Each  section  was  not  soparatoly  timed, 
although  timo  limits  for  eaoh  section  wore  rocommended  in  the 
instructions  to  the  examinees.  The  soctions,  number  of  itoms,  and 
recommended  timo  limits  wore  as  follows: 


Section 

Itom  Tvdo 

Number 
of  Itoms 

Recommended 
Timo  Limit 

I 

Verbal  Analogies 

35 

15  minutes 

II 

Mechanical  Comprehension 

30 

15  minutes 

III 

Arithmetic  Roasoning 

50 

60  minutes 

Item  Soloction.  Itoms  wore  soloctod  from  provious  forms  of 
tho  OQT,  tho  Officer  Soloction  Battory  (OSB),  the  Officor  Classi¬ 
fication  Battory  (OCB),  or  drawn  from  general  itom  filos.  An 
attempt  was  made  to  assure  comparability  of  forms  by  matching 
itoms  in  torms  of  content,  indicos  of  difficulty,  and  intornal 
consistency.  Difficulty  indicos  ranged  from  approximately  .30  to 
.85  with  a  median  item  difficulty  lovol  of  .60,  Internal  con¬ 
sistency  values  wore  abovo  ,30. 

The  major  difference  betwoon  the  currently  operational  and 
now  forms  of  the  OQT  is  in  tho  number  of  Arithmetic  Reasoning 
itoms.  The  Arithmetic  Reasoning  soction  of  the  now  OQT  Forms 
contains  30  additional  items.  This  change  incorporates  a 
recommendation  from  a  study  by  Wollack  and  Guttman  (i960),  which 
found  that  quantitative  roasoning  items  are  the  most  valid  pre¬ 
dictors  of  OCS  performance. 

STANDARDIZATION  OF  FORMS  ?f  8,  AND  9 

Approximately  1600  applicants  to  OCS  wore  testod  at  39  Navy 
Recruiting  Stations  for  a  3-month  poriod.  One  experimental  OQT 
Form  (7,  8,  or  9)  and  OQT  Form  6  wore  givon  to  each  applicant. 

To  control  for  possible  practice  effects,  the  order  of  presonto- 
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tion  wns  balanced  by  randomly  dividing  the  Recruiting  Stations 
into  two  groups*^  In  ono  group,  applicants  wore  administered 
Form  7,  8,  or  9  first  and  then  Form  6  (Group  A),  whilo  the 
rover so  order  of  administration  was  givon  to  applicants  in  the 
othor  group  (Group  B). 

Tentative  norms^  wore  constructed  by  standardizing  raw 
scores  on  OQT  Forms  7  and  8^  from  Group  A  against  Navy  Standard 
Scores  (NSS)  on  OQT  Form  6,  using  the  oquipereentilo  method* 

VALIDATION  OF  FORMS  7.  8.  AND  9 

Administration.  The  throo  now  OQT  forms  wore  administered 
to  a  total  of  605  men  onrollod  in  their  first  week  of  training  at 
OCS  (Class  50),  Newport,  Rhodo  Island.  Thus,  tho  number  for  oach 
form  was  about  200* 

Criterion.  The  basic  criterion  was  performance  at  OCS, 

Three  operational  measures  of  performance  were  used.  These 
weret 

1*  Final  average]  consisted  of  a  final  weighted  average 
of  academic  and  military  aptitude  grades  for  those 
candidates  who  successfully  completed  OCS. 

2.  Total  groupt  used  the  above  scores  for  graduates  and 
assigned  a  score  of  2.4  to  all  academic  failures  (2*5 
is  the  minimum  passing  grade). 

3*  Pass  -  failt  Candidates  mere  grouped  Into  pass-fail  cate¬ 
gories  on  the  criterion  variable* 


^An  attempt  was  made  to  got  equal  N's,  Each  group  contained 
about  800  men* 

2 

A  final  standardization  is  currently  being  carriod  out  on 
a  different  snmplo  of  applicants.  This  followup  study  is  intended 
to  chock  tho  reliability  of  tho  now  norms. 

^A  Buroau  of  Naval  Porsonnol  (Pors  15)  docision  was  mndn  not 
to  mako  OQT  Form  9  operational.  Consequently,  norms  wore  not 
constructed.  Itoms  from  this  form  wore  used  to  construct  the 
Rosorve  Of floor  Candidate  (ROC)  Tost,  Form  3, 
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Analysis.  Correlations  between  the  OQT  total  and  section 
scores  and  the  criteria  were  computed.  For  the  pass-foil  cri¬ 
terion,  the  bisorial  correlation  was  used,  with  the  product- 
moment  correlation  being  used  for  the  other  criteria.  Validity 
coefficients  for  OQT  total  score  were  corrected  for  restriction 
in  range  in  order  to  provide  better  estimates  of  validities  when 
used  in  on  applicant  population.^ 


RESULTS 


Standardization 

Navy  Standard  Score  (NSS)  distributions  of  OQT  Forms  7  and  8 
are  given  in  Appendix  A. 

Table  1  prosonts  moons  and  standard  deviations,  derived  from 
the  standardization  sample,  of  the  OQT  tosts  as  wall  as  odd-evon 
reliability  coefficients  of  tho  now  forms.  A  pattern  of  higher 
moan  sooroa  whon  a  test  was  given  sooond  suggests  the  prosonoe  of 
a  practico  effect.  Product-momont  correlations  of  Form  6  with 
Form  7  (r=.84),  Form  8  (r=.8l),  and  Form  9  (r=.83)  were  obtained* 

Tablo  2  prosonts  correlations  of  now  OQT  forms  with  the  three 
operational  criteria.  Validity  coefficients  were  uniformly  high. 
When  corrected  for  restriction  in  range,  tho  total  score  validi¬ 
ties  variod  botwoon  ,55  and  ,68  (uncorrocted  valdditios  ranged  ffrom 
.51  to  .65,  with  a  median  of  ,60)  for  all  three  operational  cri¬ 
teria,  Tho  validity  coofficionts  (uneorroctod)  for  OQT  Form  6  wore 
.56  for  the  final  avorago  and  ,55  for  tho  total  group  critoria,  as 
comparod  with  Forms  7,  8,  and  9  coofficionts  of  .56-.61  and 
.58-.61  rospoctivoly. 

Table  3  prosonts  intercorrelations  among  OQT  sections.  Moons 
and  standard  deviations  for  tho  OQT  tests  aro  also  presented. 


^Correlations  between  OQT  scoros  and  OCS  individual  course 
grades,  military  aptitudo  ratings,  and  OCB  scores  were  also  com¬ 
puted,  and  are  presented  in  Appendix  B, 
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Table  1 


Moons,  Standard  Deviations  and  Reliabilities 
of  OQT  Tests 


Variable 

Group  A 

Group  B 

Odd-Evon 

Reliability* 

M 

SD 

N 

M 

SD 

N 

Fom  7 

57.11 

16.14 

276 

61.96 

16.30 

293 

.924 

Forn  8 

57.75 

15.44 

252 

62.94 

14.63 

278 

.911 

Fom  9 

57.21 

15.89 

247 

61.94 

15.59 

303 

.922 

Fora  6^ 

8.43 

775 

48.09 

8.37 

874 

— 

‘Hjorroctod  for  total  tost  roliability  using  the  Spooman-Brown 
correction  formula. 

^Forn  6  values  arc  Navy  Standard  Scores,  while  othor  variablos 
aro  raw  scoros. 
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Table  2 


Correlations  of  OQT  Forms  7,  8,  and  9  with 
Three  Operational  Criteria 


Variables  Final  Average 

Total  Croup 

Paas~Faila 

Form  6 

56 

55 

— 

Form  7 

Verbal  Analogies 
Mechanical  Comprehension 
Arithmetic  Reasoning 

(N=175) 

48 

41 

52 

(N=200) 

50 

40 

52 

(N«200) 

52 

39 

51 

Total  Score 

61  68b 

60  66b 

60  65b 

Form  8 

Verbal  Analogies 
Mechanical  Comprehension 
Arithmetic  Reasoning 

(N=174) 

35 

30 

52 

(N=205) 

42 

35 

58 

(N=205) 

43 

37 

61 

Total  Score 

56  62b 

61  65b 

65  68b 

Form  9 

Verbal  Analogies 
Mechanical  Comprehension 
Arithmetic  Reasoning 

(N=175) 

33 

38 

59 

(N-200) 

39 

36 

54 

(N=200) 

40 

30 

45 

Total  Score 

61  66b 

58  62b 

51  55b 

Moon 

3,10 

— 

— 

Standard  Deviation 

1.63 

— 

— 

^orrolations  with  pass-fail  criterion  are  biserial  coeffi- 
cionts.  All  others  arc  produo t-mooont, 

^Corrected  for  restriction  in  range. 


Notosi  1,  Product-moment  correlations  of  ,20  and  bisorial 
correlations  of  .29  aro  significant  at  the  ,01  lovol. 

2,  Docimal  points  aro  omittod  from  tho  correlation 

ooofficionts* 
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DISCUSSION 


Results  from  the  standardization  sample  indicate  that  the 
three  new  OQT  forms  are  comparable  in  difficulty  level  and  range 
of  scores.  The  test  reliabilities  vero  at  least  .90.  Although 
there  are  no  data  on  intercorrelations  among  the  forms,  their 
relatively  uniform  correlations  with  Form  6  (.81-. 84)  indioate 
that  Forms  7,  8,  and  9  may  be  usod  interchangeably. 

Validity  coefficients  for  the  throe  now  forms  were  somewhat 
higher  than  obtalnod  with  Form  6.  The  fact  that  validities  with 
tho  pass-fail  criterion  wore  ossontially  as  high  as  those  with 
the  final  average  erlterion  tends  to  indioato  that  the  forms  are 
at  the  appropriate  difficulty  lovol  for  selootlon  purposes.  That 
is,  the  forms  aro  oasy  enough  to  discriminate  among  the  borderline 
cases.  For  comparison  purposes,  two  other  tests  which  show  valid¬ 
ity  for  predicting  OCS  performance— OCB  Mathematics  and  Advanoed 
Technicians  Test  (Mathematics)— showed  marked  difforencos  in  valid¬ 
ity  coefficients  (uncorrooted)  for  final  average  (.50)  and  pass- 
foil  (.30)  criteria.'’ 

Efforts  to  increase  the  contribution  of  quantitative  reason¬ 
ing  items  wore  apparently  successful.  Tho  numbor  of  Arithmetic 
Reasoning  items  was  Increased  from  20  to  50.  Correlations  between 
this  section  and  total  soore  for  tho  throe  forms  woro  about  .90, 
with  standard  deviations  ranging  from  about  8.0  to  9.0.  Comparable 
figures  for  Forms  4,  5,  and  o  (Classification  and  Survey  Rosearoh 
Branch,  1952)  were  correlations  of  .75  to  .78  and  standard  device 
tions  of  3.8  to  4.2.  Therefore,  correlations  with  total  soore 
for  tho  now  forms  wore  higher  than  with  the  old  forms  and  vari¬ 
ability  of  scores  is  substantially  higher,  thus  indicating  that 
the  Arithmetic  Reasoning  section  contributes  more  to  the  total 
score  in  tho  new  forms.  The  high  validities  with  OCS  performance 
for  this  sootion  (see  Table  2)  imply  that  the  chango  is  for  the 
bettor. 


^Those  tests  are  part  of  tho  current  research  on  construction 
of  the  0TB,  Data  reported  hero  aro  for  OCS  Class  51* 
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SUMMARY  AND  CONCLUSIONS 


New  Forms  7,  8,  and  9  of  tha  OQT  vara  days loped  to  replace  OQT 
Forma  5  ahd  6.  Each  form  consisted  of  115  multiple-ohoioe  items 
arranged  in  order  of  increasing  difficulty  within  each  of  tha  three 
sections t  35  Verbal  Analogies  items,  30  Mechanical  Comprehension 
items,  50  Arithmetic  Reasoning  items.  This  constitutes  an  addition 
of  30  Arithmetic  Reasoning  items  over  the  number  used  in  Forms 
5  and  6, 

For  standardisation  purposes,  eaoh  new  fora  was  administered, 
along  with  OQT  Fora  6,  to  approximately  550  applioants  at  39  Navy 
Recruiting  Stations*  Noras  were  constructed  using  the  equlperosn- 
tile  method,  with  Fora  6  score  as  the  reference  variable* 

For  validation  purposes  the  new  forms  were  administered  to  a 
total  of  605  OCs  at  OOS  (Class  50),  Newport,  Rhode  Island.  Results 
shoved  them  to  be  sufficiently  reliable  and  valid  to  warrant  their 
operational  use  as  screening  instruments  in  the  selection  of  college 
graduates  for  the  OCS  program. 
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APPENDIX  A 


Distributions  of  Raw  Scores  and  Navy  Standard 
Scores  (NSS)  for  OQT  Forns  7  and  8 


Raw  Soore 


Form  7 

Form  8 

NSS 

102 

100-99 

70 

101-100 

98-97 

69 

99-98 

96-95 

68 

97-96 

94-93 

67 

95-93 

92-91 

66 

92-91 

90-89 

65 

90-88 

88 

64 

87-84 

87-86 

63 

83-80 

85 

62 

79-77 

84-83 

61 

76-75 

82-81 

60 

74-73 

80-79 

59 

72-71 

78-77 

58 

70-69 

76-75 

57 

68-67 

74-72 

56 

66-65 

71-70 

55 

64-63 

69-68 

54 

62-61 

67-66 

53 

60 

65-64 

52 

59-58 

63-62 

51 

57-56 

61-60 

50 

55 

59-58 

49 

54 

57-56 

48 

53-52 

55 

47 

51-50 

54-53 

46 

49 

52-51 

45 

48-47 

50-49 

44 

46-45 

48-47 

43 

44-43 

46-45 

42 

42-41 

44-43 

41 
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APPENDIX  A  —  Continued 


Raw  Score 


Form  7 

Form  8 

NSS 

40-39 

42 

40 

38-37 

41-40 

39 

36-35 

39 

38 

34 

38-37 

37 

33-32 

36-35 

36 

31 

34-33 

35 

30-29 

32 

34 

28-27 

31-30 

33 

26-25 

29-28 

32 

21 

27-26 

31 

23 

25-24 

30 

II 


APPENDIX  B 


Product-Moment  Correlations  of  OQT  Forms  7.  8,  and  9 
with  Criterion  Variables  * 

The  criterion  variables  are: 

a.  CCS  Academic  Courses 

1.  Engineering  and  Damage  Control 

2.  Navigation 

3.  Operations 

4*  Orientation  and  Military  Justice 

5*  Seamanship 

6.  Naval  Weapons 

b.  Military  Aptitude  Rating 

This  rating  is  a  oor?iosite  of  evaluations  by  the  academic 
instructors  and  the  company  officer  with  his  aBBistant  a  chief 
petty  officer.  Demerits,  masts,  and  extracurricular  activities 
are  considered.  Peer  ratings  may  be  considered  by  the  company 
officer  in  assigning  this  grade,  but  no  uniform  procedure  1b  sot 
forth. 


c.  0QJ3  Tests 

1.  Verbal  Reasoning 

2.  Mechanical  Comprehension 

3.  Mathematics 

4.  Relative  Movement 

5.  Spatial  Relations 


A 
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